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(54) Splicing compressed packetized digital video streams 



(57) A secondary packetized data stream (IS), such 
as a convnerdat, is spliced witti a primary pacKetized 
data stream (MS), such as a network television pro- 
gram. The system does not require decompression of 
the data in the primary data stream, and is particularly 
suitable for use at a cable system headend to allow the 
insertion of commercials from local businesses into a 
nationally broadcast television program. When a start 
signal (TJn)is received, a pre-splicing packet (700, 800. 
900, 1000) of the primary stream is detennined. The 
pre-splicing packet is the packet closest to the start time 
which cames an anchor frame (ag.. I or P frame) start 
code (706, 804, 905, 1003). To prevent a potential dis- 
continuity at the decoder (168), the pre-splicing packet 



(700, 800. 900. 1000) is processed to discard the 
anchor frame data, and to insert a number of stuffffig 
bytes (712, 812. 912. 1012) which is equal to the 
number of t>ytes discarded into an adaptation f ieki of the 
pre-splicing packet. To further maintain continuity at the 
decoder. kJentifying data of the prinrtary stream such as 
PID and PSI data, is retrieved and provided to the sec- 
ondary stream, A number of null packets (430) are 
inserted into the output stream (OS) at the transition 
point behveen the main program and the commercial to 
prevent a buffer overflow at a decoder (168) which 
receives the output stream (OS). 
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Description 

PAQKgTOMND QF THE INVENTION 

5 The present invention relates to the communication of digital video signals, and more particularly, to the insertic»i 
of digital video messages such as commercials into a pre*existing compressed packetized data stream. Data packets 
of the commercial message are spliced into a pre-existing diata stream (complying. e.g.. with the Moving Picture 
Experts GiToup (IMPEG) transmission standard) without decompressing the data in the data stream, and while maintain- 
ing compliance with the MPEG or similar digital data communication protocol. 

10 Digital transmission schemes are particularly advantageous for signals that are broadcast from a main office bf 
satellite to a cable television affiliate at a system headend. At the system headend, the digital data stream may be fur- 
ther processed and distributed to the cable system customers, for example, via a Hybrid Fiber Coax (HFC) or Fiber to 
the Curb (FTTC) network. Such an arrangement is known as an end-to-end digptal network since digital video Is com- 
pressed and transmitted from a programming source at a central office all the way to each customer's home. In an HFC 

T5 network, a distribution line includes both a coaxial cable which carries radio-frequency signals, and an optical fik>er 
which carries light wave signals. In a FTTC network, an optical fber carries the data stream from the cable system 
headend to a neighkx>rhood transfer point, or drop, and conventional coaxial cable carries the signal from the drop to 
the customer's home. At the custom^'s home, a decoder processes the digital signal to provide a st^ial for dsplay on 
a television or other display device. 

20 In such cable distribution systems, the received data stream may be processed at the headend prior to distribution 
to the system customers. In particular, commercial messages from local businesses may be inserted into the main pro- 
grams. However, in order to accomplish this, conventionatly the received digital data stream must be completely demod- 
ulated. demuRiplexed, decrypted, decompressed and decoded to recover tfie signal in the analog domaia Then, the 
desired commercial message is provided in the analog domain and inserted into the signal to provide a new analog 

25 combined signal. Rnally, the analog combined signal is digitized, encoded, compressed, encrypted, multiplexed and 
modulated for transmission to a customer's home. As can be seen, this process leaves much to be desired as It requires 
a number of time-consuming steps that must be Implemented with additional hardware, including magnetic tape record- 
ers and players. Moreover, a large magnetic tape library must be maintained and indexed. Furthermore, the conversion 
from digital to analog and back to the digrtai domain may resuft in degradation of the signal quality. 

30 Thus, it would be desirable to provide a system for allowing an auxiliary compressed digital signal such as a com- 
mercial message to be inserted into a conpressed cfigital signal of a main program without requiring decompression of 
thie data in the main program signal. Such a system should altow cable system headed operators to conveniently insert 
commercial messages into a main program which is received, for example, via a nattonwide or international satetltte cfis- 
tibution network. Additionally, the system dxnild not degrade the quality of the main program. In particular, the system 

35 should avoid any disoontim^ty which results in a non-compliant data stream. The system should also preclude proUems 
such as syntax violat'ons. decoding errors, buffer overf kyw or underflow, timing recovery problems cbe to discontinuous 
system time stamps, audio/video synchronisation problems, and video display artifacts. Furthermore, the system 
should be compatftile with MPEG and similar digital data communication standards, in addition to being fidty compatible 
with existing decoder technology. The pres^ invention provides a system having the above and other advantages. 

40 

9MMMARY OF Jf\E INVENTION 

In accordance with the present invention, a method and apparatus are presented for splicing a secondary pack- 
etized data stream, such as a commercial, with a primary packetized data stream, such as a network television pro- 
45 gram. Advantageously, the system does not require the decompression of the data in the primary data stream, and is 
particularly suitable for use at a cable system headend. 

A start signal is provided to indicate the time to initiate the splicing, that is. whm to insert the conmerctal. The start 
signal riiay be embedded as data in the nratn program, in which case it must be recovered. AHematively, the cable sys- 
tem operator may provide an external time signal. In either case, once the start signal has been received, a pre-splicing 
so packet of the primary stream is determined. Normally, the pre-spiicing packet is the packet closest to the start time 
which carries an anchor f rente start code. The anchor frame start code indicates that data of an I or P frame is cam'ed 
in the packet Typically, such a packet may canry data from the t (or P) frame, and the frame which immediately precedes 
the I (or P) frame. To prevent a potential discontinuity at the decoder, the pre-splicing packet is processed to discard the 
anchor frame data, and to insert a number of stuffing bytes which is equal to the numb^ of bytes discarded into an 
55 adaptation field of the pre-splicing packet An adaptation f ieU Is created if R does not already exist 

Addrttonally, to maintain continuity at the decoder, identifying data of the primary stream such as PID and PSI data. 
Is retrieved and provMed to the secondary stream. 

Furthennae, it may be necessary to ins^ a number of null packets into the output stream at the transitton point 
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between the mam program and the commercial. In particular, a number L of null packets are provided rn the output 
stream to prevent a buffer overflow at a decoder which receives the output stream. The null packets are inserted 
between the pre-splicing packet of the main program and the f iist packet of the commercial. Similarly, when there is a 
transrtion back from the commercial to the main program, additional null packets may be inserted The nuntet L is 
detercnined according to the data rates of the primary and secondary streams, and provides a corresponding padding 
delay time which reduces the decoder's buffer le/el. f woing 

^■^^ ^ ^ commercial to the main program, a post-splicing packet of the main proaram 

whij Mtows the pre-splicing packet is detennined. Typically, the post^icing packet will have a sequence staitcode 
which follows the sequence end code which is associated with the last packet of the commercial. The post-splicing 
packet IS positoned to follow the last packet of the commercial in the output stream. Moreover, processing of the post- 
splictng packet is analogous to processing of the pre-splteing packet Specifically, data in the post-splicing packet vlhich 
IS associated with an immediately preceding packet, whteh may or may not be the same as the pre-splicing packet "is 
discarded to preventa discontinuity at Ihedecoder. Moreover, an amount of stuffing data is added to an adaptatonfi^ 
of the post-splicing packet based on the amoum that was discarded. An adaptation field is aeated If it does not already 
exist ' 

A corresponding apparatus, inchJding an insertion processing module, is also presented. 

AdeoxJerisalsopresertedfordeoodlngatransportdatastreamwhfehconprisesamainprogramandaco^^^ 
aal. The decoder includes a buffer for storing the transport data. The buffer has a size that is modeled at the insertion 
processing unit by a virtual buffer scheme. A processor is coupled to receive data from the buffer for processing to pro- 
vide a s^al which is routed to a television for display of the main program and the commerolal. in turn. A number! of 
nuB packets are provided between a pre-splicing packet of the main program and a first packet of the commercial to pre- 
vent overflow of the buffer. In particular, the number L is determined according to the respective data lates of the main 
prograim and the commerdal. Additionally. L n^^ 

accadii^ to a padding delay which prevents a decoding discontinuity^ The decoder provides a signal for display on a 
display dance such that a transition between the main program and the commercial, and back again, is substantially 

BRIEF DESCRIPTION OFTHF np&w^M^ 

FIGURE 1 is a block diagram of a Rber-to-the-Cuib Digital Video Distribution fretwork in accoitlance with the 
present invention. 

FIGURE 2 is a block diagram of a Hybrid Fiber Coax Digital Video Distribution Network in accordance with the 
presOTt invention. 

FIGURE 3 is a block diagram of a Digital Ad Insertion Module in accordance with the present invention 
FIGURE 4 IS a bk>ck diagram of an Insertton Processing Unit of a Digital Ad Insertion Module in accordance with 
the present inventtoa 

FIGURE 5 Illustrates the processing flow of the Insertion Processing Unit of FIGURE 4 In accordance with the 
present invention. 

FIGURES 6a to 6c are diagrammatic illustrations showing how variable length PES packets are reorganized into 
fixed length transport packets for use in providing a transport nwHiplex Ibr transmissioa 

FIGURES 7a-7d show a pre-splicing data packet having an adaptation field and PES header before and after 
processing In accordance wfth the present Inventioa w^wre ana aner 

FIGURES 8a and 8b show a pre-splfeing data packet having an adaptation fiekJ but no PES header before and after 
processing in accordance with the present invention. 

FIGURES 9a-9d show a pre-spBcing data packet having no adaptation f idd but v»«h a PES header befbre and after 
processing in accordance with the present inventioa 

FIGURES 10a and 10b show a pre-splidng data packet having no adaptation field or PES header before and after 
processing in accordance with the present inventicm. 

FIGURES 1 1a-1 Id show a post-splicing data packet having an adaptation field and PES header befbre and after 
processing in accordance with the present invention. 

FIGURES 12a and 12b show a post-splidng data packet having an adaptation field but no PES header before and 
after processing in accordance with the present invention. 

FIGURES 13a-13d show a post-splicing data packet having no adaptation field but with a PES header before and 
after processing in accordance with the present invention. 

FIGURES 14a and 14b show a post-splicing data packet having no adaptation field or PES header before and after 
processing in accordance with the present invention. 
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DETAILED DESCRIPTION OF THE iNVENTION 

A method and apparatus are presented for splicing a secondary packettzed data stream, such as a commercial, 
with a primary packetized data stream, such as a network television program. 

5 FIGURE 1 is a block diagram of a Fiber-to-the*Curb Digital Video Distribution Network in accordance with the 
present invention. The distributton network Includes Video Information Providers (VIPs) shown generally at 100, a gate- 
way, shown generally at 120, an access network, shown generally at 140, and the home of a VkJeo Information User 
(VIU), shown generally at 160. The gateway 120 may comprise an LI Gateway manufactured by Teleco. The VIPs may 
include a video server 102, an interactive data server 104, and an intmet gateway 106, all of which communicate with 

10 an asynchronous transfer mode (ATM) network 122 via. for example, an OC-3 system, where optical fiber is used to 
transmit data at 155.52 Mbit/sea The ATM network 122 may also receive c^a via a satellite receiving antenna 110. 
broadcast encoder and server 1 12, and ATM multiplexer 1 14. The ATM network 122 communicates with a session man- 
ager 123. 

The ATM network 122 may provide infbrmatfon to one or more access networks, such as a cable televisfon distri- 

IS button headend 1 40. First, however, the infbrmatfon from the ATM network is processed via a Digital Ad Insertion Mod- 
ule (DAIM) 130 in accordance with the present invention. Information, such as a network television program, passes 
between the ATM network 122 and the DAIM 130 via an ATM recaver (Rx) inteilace (iff) 124. The DAIM 130 receives 
the informatfon as a compressed digital packetized data stream and accesses an inserted stream storage unit 135. The 
storage unit may include a digitized ttorary of advertisements (e.g., commercials) which are available to insert into the 

20 network television program The storage unit 135 may include digital audio tapes (DATs), digital vkleo disks (DVDs), 
compact audfo discs (CDs) or other magnetic or optical storage media. 

In accordance with the present invention, the DAIM 130 inserts a compressed digital packetized advertisement 
stream into the compressed dgital packetized data stream of the network television program without decompressing 
the program. Moreover, when the television program is in an MPEG-2 or similar format the DAIM maintains complianoe 

2$ with the MPEG-2 protocol. Of course, while the embodiment of FIGURE 1 Is particularly suited for the insertion of 
advisements into a network televiston program, there are many other useful applications, including the insertton of 
educational programnnng. emergency meccages such as weather bulletins, informational messages from the cable 
system operator, and the like. Furthermore, audio only or data only messages n)ay be inserted into the main packetized 
data stream. Moreover, the same message may be inserted into more than one main program at the same time, and 

30 different messages may be inserted into different main programs at the same time. 

A compressed digital packetized data stream which includes ttie inserted message combined with the main pro* 
gram is output from the DAIM 130 to an ATM transmitter (Tx) interfoce 126. and then provkled to an access network 
(e.g., cable system headend) 140. In the access network 140. a Host Digital Terminal (HDT) 144 receives the data 
stream and also receives control signals from an element manager 142, which manages the cable network. The HDT 

35 1 44, whtoh is a specialized digital switoh which is typically tocated in a head office of the cable system, communicates 
with one or mae Optical Node UrAs (ONUs), including ONU 1 46. The ONU is tocated in ttie local curb, and supports 
an optical to electrical conversion and modulation/demodulation. The ONU 1 46 then f^ovkJes the data stream over a 
coax distribution network to one or more subscriber's homes or offices. At each home, a drop tX3X 164 tocated near ttie 
home receives tiie cont>ined digital signal and provides it to a Digital Entertainmerrt Terminal (DET) (e.g., decoder) 1 68 

40 and a Network imerface Module (NIM) 166. The DET decodes ttie packetized data stream, and ttie signal is seamlessly 
defivered for display to the Vkleo information User (VIU) (a.g.. subsaber) via televisions 170. 172 and/or personal com- 
puter 174. 

FIGURE 2 is a block diagram of a Hybrid Rber Coax Digital Video Distribution Network in accordance witti the 
present invention. Uke-numbeed elements correspond to the elements of FIQU RE 1 . The distraxition network includes 

45 a satellite uplink, shown generally at 200. a satellite downlink, shown generally at 240, an access network 140 and a 
VIUs home 160. The satellite uplink 200 includes a t>roadcast encoder and server 205. which may also perform an 
encryption function, an MPEG nrtuttipleKer 210. a modulator 215, and a transmitting antenna 220. The satellite downlink 
240 includes a receiving antenna 242, and an integrated receiver 244. The e^nal received at the antenna 242 typically 
comprises a multiplex of encrypted channels (e.g.. one hundred or more channels) from various programnring sendee 

so providers. The received multiplexed signal is processed at the integrated receiver 244 by a demodulator 246 and 
decryption function 248. 

The recovered muKiplex of channels is then provkled to the DAIM 250 for processing in accordance witii the 
present invention. The DAIM accesses an inserted stream storage unit 1 35 to retrieve a conrpressed digital packetized 
message for insertion into one or more main channels of ttie multiplex. After processing by tiie DAIM. the one or more 
55 combined sigr»ls are received by a transcoder 260 for encryption and/or modulation at function 265. as well known h 
ttie art The multiplex of signals, including tiie signal witti ttie inserted messages, is then received by the access network 
140 and transmitted to the subsaft)ers' homes tor display at ttie VIU*s home 160 as discussed in connection witti FIG- 
URE 1. 
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FIGURE 3 is a block diagram of a Digital Ad Insertion Module (DAIM) in accordance with the present invention. 
Advantageously, the DAIM 300 is compatible with existing communication netwaks, including the Rber-to-the-curb net- 
work of FIGURE 1 , and the Hybrid Fiber Coax network of FIGURE 2. The DAIM receives a main stream (MS) which 
comprises a primary data stream such as a network television program, and an insertion stream (IS), which comprises 
a secondary data stream such as a commercial message. Within the DAIM, an external control interface 310 commu- 
nicates with an Insertion Processing Unit (IPU) 400. After the commercial message is inserted into the main stream an 
output stream is produced. 

FIGURE 4 is a bkxk diagram of an Insertion Processing Unit (IPU) of a Digital Ad Insertion Module in accordance 
with the present invention. The IPU. shown generally at 400. receives the main stream at a packet framer 405. while the 
insertion stream is received at another packet framer 410. After processing by the packet framer 405. the main stream 
is provkJed to a Main Stream Parser (MSP) 415. The MSP also receives an input labeled TJn. which is the desired 
starting time of the insertion of the insertion stream into the main stream. Similarly, after pTocessing by the packet 
framer 410. the insertion stream is provkJed to an Insertion Stream Parser (ISP) 420. The ISP also recces an input 
labeled T.out. which is the desired ending time of the Insertion of the insertion stream into the main stream. TJn may 
be carried in the main stream, or it may be provkJed locally, such as at the cable sy^em headend. Similarly. T_out may 
be carried in the main stream, insertion stream, or may be generated locally 

The main stream parser 415 parses the data packets of the main stream and provkles signals to a vkJeo buffer 
manager 425. These signals include a Program Clock Reference (PCR). a Decoding Time Stanp (DTS). and a video 
bit rate, R_v. for the main stream. Similarty. the insertion stream parser 420 parses the data packets of the insertion 
stream to provide PCR\ DTS* and R_V signals to the vkJeo buffer manager 425, where the prime notatton Indicates a 
parameter of the insertion stream. The vkJeo buffer manager 425 uses the input signals to determine a number, N, of 
null packets which wSI be inserted irrto the output data stream. In particular, to avokJ a decoder buffer overflow, it may 
be necessary to add null packets to the output stream during the transition from the main to the insertion stream, and 
during the transition from the insertion to the main stream, if the insertion stream has a Wgher data rate than the main 
stream. The number of null packets is provided to a null packet generator 430 and then to a Data Buffer (DB) 485 which 
is part of an output buffer 475. The DB 485 communicates with a syntax processor 470. 

The main stream parser 41 5 provides the main stream data to a main stream buffer 480. which communicates with 
a syntax processor 470. The main stream buffer 480 is part of the output buffer 475. The insertfon stream paiser 420 
provkles the insertion stream data to a Program Specific Information (PSI)/Program kJentifier (PID) Replacer 435, 
which replaces the PSI tables and PIDs of the insertion stream with those of the main stream. The PSI/PID replacer 
435 retrieves the relevant information from the main stream using a communfeatioh path which is not shown. The PSI 
and PID data of the main stream provkJe the information to conned the various audia video, and data packets to a par- 
ticular programming sen^ice. Specifically, this is accomplished using a Program Association Table (PAT) and a Program 
Map Table (PMT). The insertion stream is then provided to an Insertion Stream Buffer (ISB) 490, whfch is part of the 
output buffer 475. The ISB 490 communicates witii a syntax processor 470. Furthemwe, the output buffer 475 receives 
commands fran a buffer controller 465 to provkle an cnitput stream with the insertion stream seamlessly spliced into 
the main streant 

Furttier details of the various elements of the insertion processing unit 400 of FIGURE 4 will now be discussed. The 
foltowing terms and variables will be used: 



IPU: Insertion Processing Unit - a unit inside the Digital Ad-Insertion Modula 

Main Stream (MS): The incoming digital stream that canies the normal digital vkJeo programming services. 
Insertiwi Stream (IS): The digital stream segment that will be inserted into tiie main stream. 
Output Stream (OS): The outgoing main stream after insertion. 

T_in: The external signal indicating tiie desired starting time of tiie insertion in the main stream. 

T.ait: The external si^al indicating tiie desired aiding time of tiie insertim in the main stream. 

spjn: The insertion starting position, or splicing start point, in tiie main stream. It is generated internally by the 

DAIM, and is not necessarily coinddent with T_in. 

6p_out: The insertion ending position, or splicing end point, in the main stream. It is generated internally by tiie 

DAIM, and is not necessarily canckJent witti T_out. 

spJn ': The starting position of tiie insertion segment in tiie insertion stream. 

sp.out': The ending position of the insertion segment in the insertion stream. 

MPEG: Moving Pteture Experts Group for vkleo, audio and system coding format 

TS: The MPEG Transport Stream whfeh uses tiie 188 byte packet format 

Nun Packet: A transport packet ttiat does not contain any valkJ audfo/video data. 

L: Number of nUI packets. 

PID: The Program IDentifier canied in each MPEG transport packet nrxlicating ttte presence of a data stream, 
PSI: Program Specifk; Infbmiation carried in the transport pad^et indicating tiie mapping of a group of PIDs to indi- 
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vidual programs. It includes PAT/PMT. 

PES: Packetized Elementary Stream is a layer of data carried by the TS. 
ES: Elementary Stream • can t>e video, audio, or data. 

PGR: Program Clock Reference - system dock time stamps which are carried in the main stream. 
5 PGR': Program Clock Reference • system dock time stamps which are carried in the insertion stream. 

DTS: Decoding Time Stamps indicating the decoding time of each ES element in the main stream. 

DTS': Decoding Time Stanps indicating the decoding time of each ES element in the insertion stream. 

R_v: Video bit rate tor the main stream. 

R_v*: Video bit rate for the insertion stream. 
10 Sequence Header: The highest layer of header in a MPEG video stream. 

OOP Header: Group of Pictures header - the second layer of header followed by a corrplete self-contained 

sequence of pictures (e.g.. frames). 

Picture Header: The header which precedes each picture. 

I Picture: tntra-coded picture that can be decoded without referring to another picture. 
15 P Picture: FonArard predided picture that can be decoded using the previous decoded I or P picture. 

Anchor Picture: I or P pidures are anchor pictures since they may t>e used as a reference to predtd another picture. 

B Picture: Bi-directionally predided picture that can be decoded using the previous and next t or P decoded picture. 

Cannot be used as an anchor pidure. 

vby__Buffer: Virtual Buffer Verifier (VBV) • a conceptual decoder channel buffer that shall not overflow or underflow. 
20 R_t: Transport stream data rate. 

The IPU 400 can process a main transport stream that includes one or more programs (e.g.. channels). If the main 
stream canies only a single program, the IPU inserts the insertion stream into the main stream. Note that the terms 
"insertion stream.' "secondary stream." or the IBce as used herein can denote replacement (e.g.. overwriting) of packets 
2S of the main stream as well as insertion wHtuHit loss of any main stream packets. However, this latter case wBi require a 
large amount of memory to store the portion of the main stream which is temporarily suspended while the insertion 
stream is transrrvtted. 

If the main stream cames a plurality of programs, the tPU can insert the packets of the insertion stream into trans- 
port packets in the main stream that belong to one or more seleded programs. In this case, the data rate of each ele- 

30 mentary stream in the insertion stream shouM be the same as the data rate of the corresponding programs in the main 
stream. For example, the rate d a video elementary stream in the insertion stream shouU be equal to the rate of the 
vMeo elementary main stream which is to receive the insertion data. TTie IPU processes the packets near the beginning 
and end of the insertion so the resulting stream is MPEG complianL 

The main stream packet framer 405 receives a fully compfiant, unaligned MPEG-2 main transport stream at Hs 

35 channel input The irain stream data is in a serial fbmriaL The MPEQ-2 transport packet synchronizatton byte may 
occur at any bit position. The packet framer 405 provkles the transport packet alignment, and outputs a transport 
stream which is aGgned to the packet boundary. The insertion stream packet framer 410 performs a similar function for 
the insertion stream. 

The Main Stream Parser (MSP) 41 5 and Insertion Stream Parser (ISP) 420 are used to parse the main stream and 

40 insertion streams, respectively. The stream parsers parse the respective aligned streams of the packet framers 405 and 
410 from the transport layer to the picture layer. At a time prior to TJn, the MSP 415 bypasses the main stream in its 
input and send the stream diredly to the main stream buffer 480, and the ISP 420 paraes the input insertion stream to 
locate the sequence start code. When a pactet with a sequence start code is deteded in the insertkm stream, the ISP 
puts the address of this packet into a register (not shown). The address Is a read address for the insertion stream. 

45 As soon as T_in is deteded. the MSP parses the main stream to locate the transport packet with the next, or most 
recent previous (if still available), anchor picture start code. When an I or P picture start code is found in the main stream 
transport packets, the MSP 415 sends the transport packet which contains the anchor picture start code (6.g., the last 
packet of the main stream) to the syntax processor 470 for processing. Also at this time, the ISP 420 sends the fffst 
packet of the tnsertk)n stream to the syntax processor 470 to be *1ixed" or 'repaired", as discussed below in greater 

so detail. When a video buffer verifier (e.g., MPEQ parameter Vbv_buffer") management is required, the MSP 415 and ISP 
420 will also have to parse the PGR. DTS. video rate R_y or R_v', and other parameters as required, store them in the 
data buffer 485, and provide them to the vkleo buffer manager 425. 

The VBV is a hypothetical decoder which , is conceptually oonneded to the output of an encoder. CodBi data is 
placed in the buffer at the constant bit rate that is being used, and is removed according to which data has been in the 

55 buffer for the longest period of time. The bitstream produced t>y an encoder or editor must not cause the VBV to ei^er 
overflow or underflow. The MSB 41 5 and ISB 420 output the same transport stream which appeared at the input after 
parsing as discussed. 

At the time T.out, the operation of the MSP and ISP is sirrdar to the TJn point, except ttiat the main stream and 
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Insertion stream are Interchanged. That is. after the insertion stream has been inserted into the main stream, the main 
stream iTwst be coupled with the end d the insertion stream. To acconpl^ outlsdetected the ISP 

will parse the insertion stream to locate the transport packet with the next, or most recent previous (« stfll a^laUe) 
anchor picture start code. When an I or P picture start code is found in the insertion stream transport packets the ISP 
420 sen* the transport packet which contains the anchor picture start code (e.g.. the last packet of the insertion 
stream) to the syntax processor 470 for processing. Also at this time, the MSP 415 sends the first packet of the remain- 
der of the mam stream to the syntax processor 470 for processing. In this manner, the transition from the end of the 
insertion stream to the beginning of the remafrxJer of the main stream can be performed seamlessly. 

The video buffer manager 425 checks fer the funness of the video buffer according to its inputs. PGR PGR* DTS 
DTS'. and video data rates R_v and R_v'. In case of a potential buffer overflow, it instructs the null packet generator 430 
to generate L null packets and insert the packets into the output stream. TTie nurrtoer of packets to generate is stored 
in a register. 

The syntax processor 470. which can communicate with the MSB 480. DB 485 and ISB 490 of the output buffer 
475. processes the last packet before the splicing point and the first packet after the splicing point to provkle a seamless 
transition that is MPEG compliant At TJn. the syntax processor 470 reads the last transport packet from the main 
stream andthefrretp^t from the insertion stream. It checks the syntax of the packets and repaire them. If necessary, 
so that they will be MPEG compliant, as will be discussed betow in greater detail. At T out. the syntax processor 470 
operates in the similar way except that the main stream and insertion stream are interchanged. That is. the syntax proc- 
«sor 470 will read the last transport packet from the insertion stream and the first packet from the main sfream and 
then check the syntax of the packets and repair them, if necessary. Thus, the syntax processor 470 receives unfixed 
packets and addresses for the unTixed packets, and outputs fixed packets. 

In the event of potential buffer overftow, the null packet generator 430 is insfructed by the vMeo buffer manager to 
generate null packets and insert them to the output. Thus, the null packet generator 430 receives a signal to generate 
nun packets, and the number L of packets to generate, and outputs nun packets. 

H is desired that the PIDs of the resulting output sfream do not change after the insertion. Accordingly a PSI/PID 

^ *° '^^"^ ^ ^ "^'^ ^ '"Sorted Sfream with those of the maS ^eam The 

PSI/PID replacer 435 receives fransport packets with the old PSI/PID. new PSI tables, and a PID oonverskm tabia and 
outputs fransport packets with the PSI/PID replaced. 

PC. ^ °y^^er 475 te divided intt> three parts. The Data Buffer (DB) 485 is used to store common data such as 
PSI and niil packets. The Mam Sfream Buffer (MSB) 480 and Insertkwi Sfream Buffer (ISB) 490 are used to store the 
main sfream and insertnn sfream, respectively. 

Abuffer controller 465 is used to coonlinate the read and write operations of the DB, MSB, and ISB. Halsopertbrms 
addressing and output scheduling of each fransport packet stored in the MSB. ISB and DB. 

A group of registers (not shown) is used in the system for sfrxing various parameters' such as packet addresses 
JSiC"?!' . "i^^St '^^^ which may be used in accordance with the present invention is 

givenmTaWe 1. below. It shouW be appreciated that Table 1 is an example only, and any other suitable map could be 
used. In Table 1 . the first column indicates the register index, the second column indicates the number of bits, the thiitl 
column indicates whether read (R) and/or write (Vyo capability is required, and the fourth column describes the function 
ot the register K>cation. 
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Table 1 



Index 


Bits 


RAV 


Descrvtion 


1 


7:0 


R.W 


Read address for main stream 


2 


7:0 


R.W 


Read address for main stream 


3 


7:0 


R.W 


Read address for main stream 


4 


'7:0 


R,W 


Read address for main stream 


5 


7:0 


K.W 


Write address for main stream 


6 


7:0 


R.W 


Write address for main stream 


7 


7:0 


R,W 


Write address for main stream 


8 


7:0 


R,W 


Write address for main stream 


9 


7:0 


R,W 


Read address for insertion stream 


10 


7:0 


R.W 


Read address for insertion stream 


11 


7:0 


R.W 


Read address for insertion stream 


12 


7:0 


R,W 


Read address for insertion stream 


13 


7:0 


R.W 


Write address for insertion stream 


14 


7:0 


R,W 


Write address for insertion stream 


15 


7:0 


R.W 


Write address for insertion stream 


16 


7:0 


R,W 


Write address for insertion stream 


17 


7:0 


R.W 


PGR of current stream 


18 


7:0 


R,W 


PGR of current stream 


19 


7:0 


R,W 


PCR of current stream 


20 


7:0 


R,W 


PGR of current stream 


21 


7:0 


R,W 


PCR of current stream 


22 


7:0 


R,W 


PCR of current stream 


23 


7:0 


R,W 


OTS of curroit stream 


24 


7:0 


R,W 


DTS of current stream 


25 


7:0 


R,W 


DTS of current stream 


26 


7:0 


R,W 


DTS of current stream 


27 


7:0 


R,W 


DTS of current stream 


28 


7:0 


R,W 


Address for PAT 


29 


7:0 


R.W 


Address for PAT 


30 


7:0 


R.W 


Address for PAT 


31 


7:0 


R,W 


Address for PAT 


32 


7:0 


R,W 


Size of PAT in number of packets 


33 


7:0 


R.W 


Address for PMT 


34 


7:0 


R.W 


Address for PMT 


35 


7:0 


R.W 


Address for PMT * 


36 


7:0 


R,W 


Address for PMT 
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37 


7:0 


R,W 


Size of PMT in number of packets 


38 






Intemipt register 




7 


R 


SS, Splicing signal 1: SS is detected; 0: spfidng 
processing done 




6 


R 


MSD^ 1 : Main stream done 




5 


R 


ISD, 1: Insertion stream done 




4 


R 


MPD, 1: Null packets done 




3 


R 


APF, 1 : Anchor picture found 




2:0 


N/A 


Reserved 


39 


7:0 


R,W 


Number of Null packets to generate 


40 


7:0 


R,W 


Stream output read address 


41 


7:0 


R,W 


Stream output read address 


42 


7:0 


R,W 


Stream output read address 


43 


7:0 


R,W 


Stream output read address 


44 


7:0 


R,W 


Main video elementary stream rate 


45 


7:0 


R,W 


Main video elementary stream rate 


46 


7:0 


R,W 


Main video elementary stream rate 


47 


7:0 


R,W 


Insertion video elementary stream rate 


48 


7:0 


R.W 


Insertion video elementary stream rate 


49 


7:0 


R,W 


Insertion video elementary stream rate 


50 


7:0 


R,W 


PIDl of main stream 


51 


7:3 


RW 


PIDl of main stream 


51 


7:0 


R,W 


PID2 of main stream 


52 


7:3 


R,W 


PID2 of main stream 


53 


7:0 


R,W 


PID3 of main stream 


54 


7:3 


R,W 


PID3 of main stream 


55 


7:0 


R.W 


PID4 of main stream 


56 


7:3 


R,W 


PID4 of main stream 


57 


7:0 


R,W 


PIDl of insertion stream 


58 


7:3 


R,W 


PIDl of insertion stream 


59 


7:0 


R,W 


PID2 of insertion stream 


60 


7:3 


R.W 


PID2 of insertion stream 


61 


7:0 


R,W 


PID3 of insertion stream 


62 


7:3 


R,W 


PID3 of insertion stream 


63 


7:0 


R,W 


PID4 of insertion stream 


64 




R W 


Jrii/4 01 msertion stream 


65-68 


7:0 


R,W 


Read address for PIDl of insertion stream 


69-72 


7:0 


R,W 


Write address for PIDl of insertion stream 


73-76 


7:0 


R,W 


Read address for PID2 of insertion ^s^m 
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77-80 


7:0 


R,W 


Write address for PID2 of insmion stream 


81-84 


7:0 


R,W 


Read address for PID3 of insertion stream 


85-88 


7:0 


R.W 


Write address for PID3 of inseition stream 


89-92 


7:0 


R.W 


Read address for PID4 of insotion stream 


93-96 


7:0 


R,W 


Write address for PID4 of insotion stream 



10 

The oomplextty of the IPU largely depencfs on the video buffer management scheme. Two implOTientations of a 
video buffer management scheme in accordance wHh the present invention are presented. First, in a simplified verBion, 
the number L of nut! packets for padding the output stream to prevent buffer overflow are provided only according to the 
75 video §lementary stream data rates of the main and insertion stream. R_y and R_v*. respectively. At TJn, the nunt^er 
of packets to pad with null data is computed as: 

L = vbv^buffer.size * ( 1/R_v - 1/R_vO • RJ / (188*8). 
At T_out the number of packets to pad is computed as: 

L - vbv.buffer_.si2e * ( 1/R.v'- 1/R.v) * RJ / (188*8). 
20 The advantage of this scheme is a sinrplified implementation, and there is no need to track the PCR and DTS of the 
stream. The disadvantages are that padding is larger than needed, and decoding or display discontinuities may result. 
Note that padding is required only when the insertion stream has a higher data rate tfian the main stream. 

In a second, more conplete version of the video txiffer management scheme, padding is used according to a 
decoding delay of the main and insertion stream and the video elementary stream rates. The decoding delay is the dif- 
25 ference between the time the first byte of a picture is received and the time when decoding is conr^leted. With this 
scheme, at TJn. the number of packets to pad is computed as: 

L « (decodingLdelay • vbvJxjffer.size/Rj/l * RJ / (188*8). 
At T_out the nurTi>er of packets to pad is corrputed as: 

L = (decoding_delay - vbv_buffer_size/R.v) * RJ / (188*8). 
30 The advantages of this second embodiment are that padding is used only as needed, and there is no chance of a 
decoding or display discontinutty caused by padding. A disadvantage is that the decoding delay nust be computed, and 
therefore the PCR and DTS of the data stream must be retrieved and decoded. This requires additional hardware and 
expense. 

With either of the above schemes, the calculation of the number ol null padding packets can be computed using the 
35 following definitions and assumptions. 

Defin'rtions: 

BO: Video decoding buffer size at the end of old stream. 
40 vbv.buffer.size: 1 . 75 n/lb or 1835008 bit 
Tj>ad: Duration of null padding bits. 

At TJn point: 

BO-R_VTj)ad + (Rj/'- 
45 Rjv)*(decoding.detay-T_pad) 
^ vl3v_buffer_size: and 

T_p8d ^ decodingLdel^*(1 - R_v/R_v > 
(vbv_buffer_si2e-B0)/R_v 
Since BO » decoding_delay*R_y. we have: 
so T j)ad > decoding-delay • vbv J>uffer_6ir e/R.v 

Since decodingjdeiay < vbvJxiffer/R.v. to simplify the con^ation. T_pad can be written as: 

Tj)ad 3f vbv_buffer_size*(1/R.v - 1/Rj/ ). 
For example, if R.va4 Mbps and R_v'=8 Mbps. then the padding time will be: 
Tj)acl = 1835008 * (1/4 - 1/8) = 0.23 sec. 
55 However, this does not mean that the viewer win detect a discontinuity of 0.23 second. In fact there will be no vis- 
ible discontinuity when ttie data is displayed on a television screen since the 0.23 second delay only flushes out part of 
the data in the video decoding buffer. After 0.23 second, the data from the insertion stream will ffll the buffer while the 
decoder is stilt decoding ttie data from the main stream. As long as the time to decode the remaining data in the video 
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decoding buffer is greater or equal to 

(vl)v_delay_of_f irstjpicture - 1/|3icture_rate) of tfie insertion streanv there will be no decoding disconlini%. 
Furifiermore, at Tjxit. Tjaad is computed as: 
Tjjad i decodingjdelay - vt>/_buffer_size/R_v, 
or simplified to: ~ ~ 

T_pad t vbv_buffer_si2e'(1/R_v' ■ 1/R_v). 
71)0 number of paddng packets. N, can therelbre be confuted as: 
LoTj)ad*R_t/(188*8). 

FIGURE 5 Ulustrates the processing flow of the Insertion Processing Unit of FIGURE 4 in accordance with tee 
present invention. Note that the steps of FIGURE 5 are shown as occunring in a sequential manner for clarity but many 
of the steps may occur concunrentty and/or sequentially. At Wock 502. the IPU outputs the main transport stream from 
the mam stream buffer (MSB) 480. -me IPU is essentially in a bypass mode at this time since the insertion stream has 
not yet been inserted. At block 506. the main stream parser parses the main stream to locate the spicing signal T la 
Note that TJn need not be carried in the main stream, but maybe provided locally, for example, at a cable system head- 
end. When T_in is detected, the IPU continues to output the main transport stream from the main stream buffer. At block 
508. the main stream parser parses the main stream to k)C8te the closest packet with an anchor picture (eg I or P 
picture) start code and passes that packet to the syntax processor 470. This packet will be the last packet of the main 
stream. To ensure that the resulting data stream is MPEG compliant, no data from the next frame or sequence of frames 
may be included in this last main stream packet At block 51 2. the syntax processor adds a sequence end code field to 
the last paAet of the main stream. The sequence end code is a twenty-four trit code which indicates the end of a 
sequence of pictures. At block 514, the PSI/PID replacer 435 starts to replace the PSIffl»ID of the inswtion stream. 

At Wo* 516, the syntax processor processes the first packet of the insertion stream (e.g.. the packet which con- 
tains the sequence start code) so that any data before the sequence start code in this packet that is coming from the 
insertion stream is replaced with stuffing bytes in the adaptatkm field. If the adaptation field does not exist, it is created 
The packet's transport header and PES header are also modified to ensure that the output stream is MPEG con^iant 
The syntax proc wsor also sete the cfiscontinuity indicators of the insertion stream in iSB for all the packets before the 
PGR packet to "1 *. 

At btodt 518. the video buffer manager 425 cataulates the number. N. of nuH packets to pad. At block 520. at the 
end of the main stream, which is designated as the position sp_in. an intemipt signal. Main Stream Done (MSD) is gen- 
erated. At block 522. after receiving the MSD signal, the IPU reads the null packets from the data buffer 435 and writes 

illl^Ii" *® ^ ^ at *e end of the n Jl packets, an interrurt signal, Null Packets Done 

(NPD). is generated. 

At block 526. after receiving (he NPD signal, the system begins to output data from the insertion stream buffer 490 
at a position which is designated sp_in'. At the same time, the MSP reads from the main stream and puts a new 
3S sequence in the MSB. 

At btock S30. when T_out is detected, the processing continues at block 540. Othenmse. the system is in a wai&ig 
mode unbl T_out is received. At this time, the system continues to output data from the ISR Generally, T_out may be 
provided locaHy. tor example, by a cable system headend However, it may be preferable for T in and T_out to be pro- 
vkJed in the main stream so that the cable headend is not tasked with managing the tnne and duration of the insertion 
40 Moreover, the gap in the main stream in which the insertion stream is to be provided win not typtoally be controllable b/ 
the cable headend. At block 540. the fSP parses the insertion stream for the packet with an anchor picture start code 
and passes that packet to the syntax processor. Thte will be the last pacl«et of the insertton stream. The syntax proces- 
sor processes this last packet of the insertion stream so that there is no data from the next frame or sequence of frames 
included in the packet Thus, the resuHing data stream will be MPEG conpBant At block 544. the syntax processor 
45 adds a sequence end code fiekl to the laa packet of the insertton stream. 

At bto* 546. the syntax processor processes the first packet of the main stream (which contains the sequence 
start code) so that any data before the sequence start code in this packet that is coming from main stream is replaced 
with zeros. The packers transport header and PES header are also modified to ensure that the output stream is MPEG 
compliant The syntax processor also sets the discontinuity Indicators of the main stream in the MSB for all the oackets 
so before the PGR packet to "1". *^ 

At Uock 548. the video buffer manager calculates the number of null packets to pad. At block 550. at the end of IS 
which is designated sp_ouf. an interrupt signal. Insertion Stream Done (ISD). is generated. At btock 552. after receiv^ 
ingthe 'SD signal, the qrstem reads the null pactets from the data buffer and writes to the output stream 
at tfje end of the nuU packets, an intemipt signal. NuH Packets Done (NPD). is generated At block 556. after receiving 
the NPD signal, the system begins to read from the MSB at a point which is designated sp out. Thus, at this time, the 
insertion stream ends and the next portfon of the main stream begins to be output At the same time, the ISP readsfrom 
the insertion stream and puts a new sequence in the ISB for futore use. The process continues at block 506 where the 
MSP parses the main stream tor the next splicing signal. TJn. 
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In praclice. the invention is particularly suitable for inserting commercial messages into one or more network tele- 
vision programs. For example, often limes a network program is transmitted via satellite to tocal cable system operators. 
The cable system opmtor has the task of inserting commercials from local businesses into the main stream. In thte 
case, it may be desirable to provide commercials, for example, e^ery twenty minutes. Furthermore, assume one oonrv 

5 merdal is inserted, and that the commercial has a duration of one minute. Then, for a network program which runs from 
8:00 p.m. to 9:00 p.m.. we may have TJn=58:00 p.m.. T_out=:8:01 pm, then TJn=820 p.m.. T_out«8:21 p.m., and 
finally T_tnn:8:59 p.m.. T_outB9:00 p.m. Other variations are possa>le, of course. For example, a prerecorded series of 
commercials may be assembled. In this case, the beginning of the first commercial will correspond to TJn. and the end 
of the last commercial may con-espond to T.out. Alterr^tively. the network program may Include one or more convner- 

yo ctats already in the main transport stream, in this case, the present invention may be used to replace selected ones of 
the main stream conmercials, or to remove selected ones of the commercials without replacement. Note that the tatter 
case may not be possible in real-time. 

In order to implement the processing flow of FIGURE 5. the structure of a packetized data stream must be exanh 
ined in greater detail. In a packetized digital data stream, typically the packets carrying the compressed video data will 

15 be multiplexed with other packets. e.g., carrying conesponding audio data and control information necessary to recon- 
struct a televisk)n signal. One standard for transporting digital television signals in this manner is the MPEGh2 standard, 
details of which can found in document AVC-491 . version 1 . April, 1 993, published by the Telecommunications Stand- 
ardization Sector, Study Qroup 15. Experts Group 4ATM-Vkieo Coding of the Internatfonai Organization for Standardi- 
zation. ISO-IEC/JTG1/SC29/WQ11 entitled "Coded Representation of Picture and Audio Infonration." incorporated 

20 herein by reference; ISO/IEC 13818-2, March 25. 1994. entitled ''Generic Coding of Moving Pictures and Associated 
Audto," incorporated herein bf reference; and ISO/IEC 13818-1. April 27. 1995. entitled ''Coding of Audio. Picture, Mul- 
timedia and Hypermedia Information.'* incorporated herein by reference. Further details of the video syntax and seman- 
tics for MPEG*2 vkJeo can be found in International Organization for Standardization document ISO/IEC 111 72-6 dated 
April 2. 1993 and entitled "Revised Syntax and Semantics for MPEG-2 Video, " also incorporated herein by reference. 

25 Also of interest, and incorporated herein by reference, is document MC68VDP/D. a preliminary data sheet entitled 
''MPEG-2/DCII VMeo Decompressfon Processor," ^Motorola Microprocessor and Memory Technologies Group. 1994 
which describes a vkJeo decompression processor using the MPEQ-2 and DigiCipher®ll standards. 

In the MPEG-2 system (and the similar DigiCtpher® II system proprietary to General Instrument Corporation, the 
assignee hereof) a transport stream, or transport multiplex is made up of a contiguous set oUlxsd length packets. Each 

30 packet is 188 total bytes in length, with the first four of those bytes t>eing defined as the packet header. The paytoad 
portion of each packet is thus nonnaHy 1 84 bytes. However, a variable length adaptation f ieM may be provkled to extend 
the header, when required. When an adaptatfon field is present the paytoad portion of the packet wiH be correspond- 
ingly shorter. 

Various timing and ktentif tcatfon information is provkled in different portions of the transport stream. These include 
35 a packet kJentifier (PID) found in the transport header of each transport packet to provide a reference number for iden- 
tifying the transport packets carrying a specific service component This number is included in a service definition or 
"servce map" used t>y the receiver to klentify those transport packets required to reconstruct a televisfon program sig- 
nal. The PID may also be referenced fbr various grooming and remultiplexing functions. In the case of vkteo. audio or 
isochronous control data, the stream of packets labeled with a single PID represents a sln^e vkteo, aucfio or iso* 
40 chronous data service elementary stream, respectively. Each type of packet will have a different PID identifying the 
packet type. 

Timing infbrmation carried by the transport stream includes a program clock reference (PCR) whfoh effectfvety rep- 
resents a sample of the system time clock (STC) time base that underlies the sarvioe composed of the PIDs referenced 
in the service mapi The PID canying the packet with the PCR is also referenced in the service map. The vkleo, audb 

45 and isochronous data components of a service are focked through a defined rdationsh*^ to the system time dock. The 
PCR serves to define the transport rate, in the sense that between any twvo successive PCRs in one PID. the transport 
rate is constant and nominally equal to the system time clock rate times the ratio of the total numt}er of transport bytes 
between the PCRs divided by the difference in the PCRs in units of system time clock ticte. 

The timing information canied by tfie transport stream also includes time stamps for the commencement of decod- 

so ing arKi presentation of data for display. The presentation time stamp (PTS) is used fbr service oorrponent acquisition 
arxl also for evaluating whether timing and buffer control are opeating property at the decoder. The decoder time stamp 
(DTS) is used to indicate when tiie decoder shoi^d start to decode tiie first access unit (e.g.. video frame) that starts in 
the paytoad of a packetized elementary stream (PES) packet whose header includes the DTS. A packetized elementary 
stream is a data stream composed of end-to-end PES packets which have variable length and are typically for tonger 

55 ttian a fixed length transport packet. Thus, a PES packet is typfoally composed of data from a plurality of transport pack- 
ets. 

FIGURES 6d to 6c are diagrammatic illustrations showing how variable length PES packets are reorganized into 
f ixed lengtti transport packets for use in provding a transport multiplex for transmission. FIGURE 6a illustrates a portion 
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Of a packetized elementary stream carrying successive PES packets, each having a tieader (PES-HDR) 672 and a PES 
payload 674. The PES packets 670 are of variat)le length. PES packets are typically soreral thousand tjytes in length 
They are required to be aligned in such a manner that when divided into transport packet payloads, the first byte of 
every PES header is located in the first payload position of some transport packet For any transport packet canying 
the aligned PES header, a "j^yioad urtt start indicator" will be set in the transport header for the transport packet In 
the MPEG-2 and DigiCipher® II systerris. the PES fomiat is used for all service conponents that are Inherently syn- 
chronous. More partkajlarly, video, audio and isochronous data oomponeirts are canied as packetized elementary 
streams, and the PES headers 672 win cany various information necessary to define the payload. includina a oactei 
start code prefix, a stream Identification, and a PES packet length. 

The header may ateo contain a presentation time stamp (PTS) or decode time stanp (DTS). The PTS is a field 
which indicates the value that corresponding bytes of the decoder system time dock reference should have when the 
first presentation unit (i.e., video frame, audio sync frame, isochronous data access unit) whose access unit starts 
somewhere in the payload of this PES pacl«t is presented. Fbr video, an access unit starts if the first byte of the picture 
start code is present in the payload of the PES packet For audio, an access unit starts if the f irct byte of the sync word 
IS presem m the payload of this PES packet For isochronous data, an access unit starts if the first byte of the data 
header is present in the payload of this PES packet The PTS field is used for service conponent acquisHkxi, and also 
for evaluating whether tming and buffer control are operating properly at the decoder. 

The DTS is a field indicating what value conesponding bits of the decoder system time dock reference shoukl have 
when the decoder starts to decode the first access unit that starts somewhere in the paykMid of this PES packet The 
PTS and DTS difler only for video, and only in the case of the l-frame and the P-frames transmitted with B-frames. 

The PES payload contains the informatkMi data that is desired to be transmitted to a receiver. Thus, the payload 
includes aU of the videa audfo and control inlomiation necessary for the receiver to decode and reconstruct e g a dio- 
ital television signal. ' 

In order to meet the requirements of robustness and simplicity, a fixed packet length approach is prefened to the 
variable length PES packets. Thus, as illustrated in FIGURE 6b, the pad<et elementary stream containing the PES 
packets 670 is reconfigured irtto a stream of fixed length transport packets 680. The transport padtets illustrated in FIG- 
URE 6b all correspond to the same servtee component such as the video component of a di^l teievisfon transmis- 
sion. In the MPEG-2 and DigiCipher® II embodiments, each pad<et is 188 total bytes in length, with the fret four bytes 
compnsing a transport pad<et header (TP HDR) 682. The payload portion 684 of each packet 680 is thus norniaUy 1 84 
bytes. However, an adaptation field mechanism is present as illustrated by transport padwt 680\ to extend the header 
when required. The adaptatfon f iekl 686 provkles additional information which is not required for every transport packet 
The adaptation field (ADPT FELD) 686 extends the regular transport header 682 at the expense of payload 684. whicli 
will be less than 184 bytes whenever the adaptation is provided. The adaptation field 686 is of variable length, depend- 
ing on the inlomiation rt contains. Typically, the adaptation field will support addittonal information for time base recovery 
and other functions, and also provides a mechanism for padding the payload when it does not occiw the fidll 84 bytes 
Such padding can be used, for example, to make a variable rate video packetized elementary stream into a constant 
rate transport stream. 

As indicated in FIGURE 6b. the transport header of each transport packet indudes the PID vrtiich identifies the par- 
ttoular service component canied by the transport packet The PGR will be carried by an adaptation fieU to provide tim- 
ing informatton for a desired service. At a receiver, the PGR for the desired service is detected from the adaptation fiekJ 
The PiDs of the transport packets will then be monitored In accordance with the liming established by the PGR to 
recover those transport pactets canying a particular component of the serelce to be processed. 

Transport packets from various sennce components are multiplexed into a transport multiplex 690 as iOustrated in 
FIGURE 6c. The transport multiplex wiD cany interspersed packets from each of the different components (e.g. . video, 
audio and eontrd) necessary to reconstnict a service at the receiver. In the illustrative transport multiplex shown in FIG- 
URE 6c video transport padwts 680 (A,. Ag, A3...) are followed by audio components 692 (Bi. B,, B3...) which, in turn, 
are followed by control component pack^ 694 (C,. Cg, C3...). 

With the foregoing in mind, the operation of the syntax poxessor 470 of the IPU 400 in fixing the packets of the 
mam stream or the insertion can now be discussed. First the process of bk>d« 508 and 540 wiO be discussed, wherein 
the last pad<et of the main or insertion stream, respectively, before the spitting point is processed to maintain compB- 
ance wHh an MPEG or similar communication protocol. The splicing point is the boundary between the main and inser- 
tion stream pad<ets. This conesponds to the point betweai spjn of the main stream and sp in' of the nwertion stream 
when the oufout stream transHfons from the main to the insertion stream, or to the point between sp out' of the insertion 
stream and sp_out of the main stream when the oulput stream transitions from the insertion to the"main stream. 

Generally, the last packet of the data stream before the splidng pdnt has to be pocessed since the transport 
packet boundary may not be the same as the prcture boundary. This last packet wrill be referred to as a pre-splicing data 
packet In this case, the pre^icing pad<et vnO contain part of the data from the next (anchor) frame. The pre-spBcing 
packet can be fixed by discarding the data from the next frame and stuffing the same amount of bytes to the adaptation 
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field of the last packet, where rl is understood that stuffoig bytes are simply dummy bytes of data. If an adaptation field 
does not exist in the last packet it can be aeated. fstote that after fixing the information contained in the adaptation field 
and pes_hdr, including adaptationJieUJength, payload.urtt_start_indicator, pesjength, and other parametersrmay 
be changed. However, this is not expected to result in any visible discontihutty or artifacts to the viewer when the data 
5 is displayed. 

Processing of the pre-splicing packet id treated differently depending on whether the packet has an adaptatton field 
and a PES header, and further depending on the location of data fields in the packet. FIGURES 7a-7d show a pre-splic- 
ing data packet having an adaptation field and PES header before and after processing in accordance with the present 
invention. 

10 In FIGURE 7a, the packet, shown generally before processing at 700, includes a transport header 701, an adapta* 
tion fiekJ 702 candying K bytes, a first data field 703. a PES header (pes_hdr) 704, a second data field 705, a picture 
start code 706 canytng four bytes, and a third data field 707 carrying M bytes. In this case, it can be seen that there is 
data carried in the packet 700 between the adaptation Jiekf 702 and the pes_hdr 704, and between the pes hdr 704 
and the picjstart^code 706. 

15 Moreover, since the pic_start_code 706 defines the start of a new picture or frame, it can be seen that the third data 
field 707 carries data of the new frame. Thus, in accordance with the present invention, the packet 700 is processed by 
discarding the data of the pic.start.oode 706 and the associated third data f iekl 707, and stuffing 4fM dummy bytes in 
the adaptation field 702. This results in the processed packet 710 which includes the adaptation field 712, and which 
terminates with the second data field 705. The packet 710 includes data from only.one picture and does not require the 

so next adjacent packet to maintain continuity. 

fstote that in FIGURES 7-11, the relative width of a packet or a field thereof does not necessarily indicate the 
amount of data carried in the fiekl or the packet 

In FIGURE 7b, the unprocessed packet is shown generally at 720, and the processed packet is shown generally at 
730. Here, there ts data between the adaptationj ield 702 and the pes.hdr 704. but not between the pes.hdr 704 and 

25 the picjBtart.code 706. In accordance with the present invention, the packet 720 is processed by discai^ng ttte data 
of the pe5_hdr 704. pic_starL.code 706 and the third data field 707. and stuffing N+4+M dummy bytes In the adaption 
fieW 70Z This results in the processed packet 730 which includes the adaptation field 732. and which tenrtnates with 
the first data fiekJ 703. 

In FIGURE 7c. the unprocessed packet is shown generally at 740. and the processed packet is shown generally at 
30 750. Here, there is data between the pes_hdr 704 and the pic_start.code 706. but not between the adaptation JieW 702 
and the pes.hdr 704. In accordance with the pres&tt invention, the packet 740 is processed by discarding the data of 
the picjstartjoode 706 and the third data field 707, and stuffing 4+M dummy bytes in the adaptation f ieW 702. This 
results in the processed packet 750 whfch includes the adaptation fiekl 752, and which temiinates with the second data 
fteld705. 

35 In FIGURE 7d. the unprocessed packet is shown generally at 760. Here, there is no data field between the pes.hdr 
704 and the pic.startjoode 706. or between the adaptation JieW 702 and the pes.hdr 704. h accordance with"the 
present invention, as shown at 770, the entire packet 760 is not transmitted since there would be no data fields remain- 
ing after discarding the third data field 707. 

FIGURES 8a and 8b show a pre-splicing data packet having an adaptation fiekl but no PES header before and after 

40 processing in accordance with the present inventton. In FIGURE 8a, the urprocessed packet is shown generally at 800, 
and the processed packet is shown generally at 810. Here, there is data between the adaptation fiekl 802 and the 
pic.start.code 804. In accordance with the present vivention, the packet 800 is processed by discarding the data of the 
pk;.start.code 804 and the second data field 805, and stufTing 4^ dunrvny bytes h the adaptation field 802. This 
results in the processed packet 810 which includes the adaptatton fiekl 812. and which terminates with the first data 

45 fiekl 803. 

In FIGURE 8b^ the unprocessed packet is shown generally at 820. Here, there is no data field between the adap- 
tation field 802 and the pic.start_code 804. In accordance with the present Invention, as shown at 830. the entire 
packet 820 is not transmitted since there wouki be no data f ieUs remaining after discarding the second data field 805. 

FIGURES 9a-9d show a pre-splicing data packet having no adaptation fiekl but with a PES header before and after 
so processing in accordance with the present invention. In this case, an adaptatbn fiekl is created which candies the 
dummy stuffing bits wNch account for the discarded f iekls. In FIGURE 9a. tfie packet shown generally befbre process- 
ing at 900. includes a transport header 901 . a first data field 902, a PES header 903. a seoond data fiekl 904. a picture 
start code 905 canrying four bytes and a ttiird data freU 906 carrying M bytes. In this case, data is can'ied between the 
tp.hdr 901 and the pes.hdr 903, and between the pes_hdr 903 and the pic.starLcode 905. In accordance with the 
55 present invention the packet 900 ts processed by discarding the data of the pic.8tart.code 905 and the third data field 
906, and creating an adaptation field 912 witti 44M dumniy bytes as shown in the processed packet 910. 

In FIGURE 9b, the unprocessed packet is stawn generally iat 920. and the processed packet is shown generally at 
930. Here, ttiere is data between the tp.hdr 901 and the pes_hdr 903, but not between the pes_hdr 903 and the 
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FMC_stai1.code 905. In accordance with the present Invent' on, the packet 920 is processed by discarding the data of the 
pes_hdr903,pic.starLcode905.andthethifddatafield906.andcre^^^ N+4+M dummy 

bytes, as shown in the processed packet 930. 

In FIGURE 9c, the unprocessed packet is shown generally at 940, and the processed packet is shown generally at 
950. Here, there is data between the pes.hdr 903 and the pic_slart_code 905, but not between the tp.hdr 901 and the 
pes.hdr 903. In accordance with the present invwition, the packet 940 Is processed by discarding^ the data of the 
pic.stait_code 905 and the third data f ieU 906, and creating an adaptation f iekj 952 with 44M dummy bytes, as shown 
in the processed packet 950. 

In FIGURE 9d, the unprocessed packet is shown gaierally at 960. Here, there is no data f ieW between the tp hdr 
901 and the pes_hdr 903. or between the pes_hdr 903 and the pic_start_code 905. In accordance with the present 
inventton, as shown at 970. the entire packet 960 is not transmitted since there woukl be no data fields remaining after 
discarding the third data field 906. 

FIGURES 10a and 10b show a pre-splicing data packet having no adaptation field or PES header before and after 
processing in accordance with the present invention. In this case, an adaptation field is created which carries the 
dummy stuffing bits which account for the discarded f iekJs. In FIGURE 1 0a, the unprocessed packet is shown generaOy 
at 1000, and the processed packet is shown generally at 1010. Here, there is data between the tp_hdr 1001 and the 
pic_start.code 1003, In accordance with the present invention, the packet 1000 is processed by discarding the data of 
the pic_start_code 1003 and the second data field 1004, and creating an adaptation fieW 1012 with 4+M dummy bytes, 
as shown in the processed packet 1010. 
20 In FIGURE 10b. the unprocessed packet is shown generally at 1020. Here, there is no data fieW between the tp.hdr 
1001 and the pic.starLcode 1003. In accordance with the present invention, as shown at 1030, the entire packet 1020 
is not transmitted since there would be no data f leMs remaining after discarding the second data f leki 1004. 

Now, the process of blocks 51 6 and 546 will be discussed, wherein the first packet of the main stream after the sec- 
ond splfcing point (e g., sp_out), is processed to maintain compliance with the MPEG or similar communication proto- 
ns col. This first packet will be refen-ed to as a post-splicing data packet. As with the pre-splfcing packet, processing of the 
post-splicing packet is treated differently depending on whether the packet has an adaptation fieM and a PES header, 
and further depending on the location of data fiekJs in the packet. In particular, flie first post-spficing packet must be 
processed by the syntax processor 470 when the splicing point does not correspond exactfy to a picture boundary. In 
this case, tiie post-splidng packet may contain part of the data from a previous picture or sequence of pictures. 
30 In accordance witti the present inventfon, tiie post-splicing packet is fixed by discarding the data from the previous 
sequence and stuffing a compensating number of dummy bytes to the adaptation field of the post-splicing packet. Fur- 
thermore, an adaptation fieU is aeated if it does not already exist. Moreover, as with ttie processing of the pre-spficing 
packet tiie infonrnation contained in the adaptation Jield and pes.hdr. including 
adaptationJieUJengtti. 

35 paytoad^unit.startjndicator, pesjength. and other parameters, may be changed, but ttiis is no expected to result in 
any visible discontinuity or artitacts to the viewer when the data is displayed. 

FIGURES 1 1a-1 Id show a post-splidng data packet having an adaptation field and PES header before and after 
processing in accordance with the present inventioa In FIGURE 1 la, flie packet shown generally beft^e processing at 
1100, includes a transport header 1101, an adaptation field 1 102 can-ying K bytes, a first data field 1103 can-ying N 

40 bytes, a PES header, pes.hdr 1 104, a second data field 1 105 carrying M bytes, a sequence start code 1 106 and a third 
data field 1107. In this case, it can be seen that there is data carried between the adaptation JiekJ 1 102 andttiepes hdr 
1 1 04. and between the pes.hdr 1 104 and the seqj5tart_oode 1 1 06. 

Moreover, the seq_slart_code 1106 defines ttie start of a new sequence of pictures, and the first data field 1103 
and tiie second data field 1 105 can-y data of a picture from a prevfous sequence. Thus, in accoidance with ttie present 

45 invention the packet 1 1 00 is processed by discarding ttie f rst data f iekJ 1 1 0 and the second data field 1 1 05. and stuffing 
N+M dummy bytes in tfie adaptation field 1 102. This results in ttie processed packet 1110 which includes tfie adapta- 
tion field 1 1 12. The packet 1110 includes data from only one sequence of pictures and does not require ttie previous 
adjacent packet to maintain continuity. 

In FIGURE lib, tiie unprocessed packet is shown generally at 1 120. and tiie processed packet is shown generally 

so at 1 130. Here, tiiere is data between tiie adaptationJieW 1 102 and ttie pes.hdr 1 104. but not between the pes hdr 
1 104 and the seq.start.code 1 106. In accordance with ttie present invention, tiie packet 1 120 is processed l>y diswd- 
ing tiie frst data fieU 1 103, and stuffing N dummy bytes into the adaptation fieki 1 102. This results in the processed 
packet 1 130 which includes tiie adaptation field 1 132. 

In FIGURE 1 1c, the unprocessed packet is shown generally at 1 140. arxi the processed packet is shown generaDy 

55 at 1150. Here, *>ere is data between the pes_hdr 1104 and the seq_start_code 1106. but not between the 
adaptationJiekJ 1102 and ttie pes jKir 1104. In accordance witfi tiie present invention, the packet 1140 is processed 
by discarding ttie seccwxJ data field 1 105, and stuffing M dummy bytes in the adaptation field 1 102. This results in tiie 
processed pad^ 1 150 whk;h includes the adaptation fieU 1 152. 
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tn FIGURE lid. the unprocessed packet is shown generally at 1160. Here, there is no data field between the 
pes.hdr 1 104 and the secLStart.code 1106. or between the adaptationjield 1102 and the pesjKir 1 104. In accoid- 
ance with the present Invention, the entire packet 1 160 is transmitted without modification since there is no data fieM 
prior to the secL.6tart_code 1 106. 

5 FIGURES 12a and 1 2b show a post-splidng data packet having an adaptation field but no PES header before and 
after processing in accordance with the present invention. In FIGURE 12a. the unprocessed packet is shown generally 
at 1200. and the processed packet is slwm generally at 1210. Here, there is data between the adaptation field 1202 
and the seq^starLcode 1 204. In accordance with the present inventioa the packet 1 200 is processed by discarding the 
first data field 1203 and stuffing N dummy bytes in the adaptation field 1 202. This results in the processed packet 1210 

10 which includes the adaptatton field 1212. 

In FIGURE 12b, the unprocessed packet is shown generally at 1220. Here, there is no data field between the adap- 
tation field 1202 and the secLStart^code 1204. In accordance with the present invention, tfie entire packet 1220 is 
transmitted without modification since there is no data field prior to the secL.start_code 1204. 

FIGURES 13a-13d show a post-splidng data packet having no adaptation fieki but with a PES header before and 

75 after processing in accordance with the present invention, tn FIGURE 13a, the packet, shown generally before process- 
ing at 1300, includes a transport header 1301, a first data field 1302 carrying N t>ytes, a PES header 1303. a second 
data field 1304 canying M bytes, a sequence start code 1305 and a third data field 1306. In this case. It can be seen 
that there is data carried in the packet 1 300 between the tp.hdr 1 301 and the pes.hdr 1 303, and between the pes.hdr 
1 303 and the 8eq.start_code 1305. In accordance with the present invention the packet 1300 rs processed by dis^rd- 

so ing the first data fiekl 1302 and the second data field 1304. and creating an adaptation field 1312 with NhkM dummy 
bytes as shown in the processed packet 1310. 

In FIGURE 1 3b. the unprocessed packet is shown generally at 1 320. and the processed packet is shown generally 
at 1 330. Here, there is data between the tp.hdr 1 301 and the pes.hdr 1 303, but not between the pes.hdr 1 303 and the 
8eq_start_G0de 1305. tn accordance with the present invention, the packet 1320 is processed by discarding the first 

25 data field 1302. and creating an adaptation fiekl 1322 with N dummy bytes, as shown in the processed packet 1330. 
In FIGURE 13c. the unprocessed packet is shown generally at 1340. and the processed packet is shown generally 
at 1350. Here, there is data between the pes.hdr 1303 and the secustarLcode 1305, but not between the tp.hdr 1301 
and the pes.hdr 1303. In accordance with the present inventioa the packet 1340 is processed by discarding the sec- 
ond data fiekl 1304, and creating an adaptation flekJ 1352 with M dummy bytes, as shown in the processed packet 

30 1350. 

In FIGURE 13d. the unprocessed pack^ is shown gently at 1360. Here, there is no data field betwe^ the 
tp.hdr 1301 and the pes.hdr 1303, or between the pes.hdr 1303 and the seq_slart_code 1305. In accordance with the 
present invention, the entire packet 1360 is transnMed without nxxJification since there is no data field pnor to the 
secL.start_code 1305, 

3S FIGURES 1 4a and 1 4b show a post-splicing data packet having no adaptation fiekl or PES header before and after 
procesdng in accordance with the present invention. In this case, an adaptation fiekl is created which cames the 
dumnry stuffing bits which account for the discarded fields. In FIGURE 14a, the unprocessed packet is shown generally 
at 1400, and the processed packet is shown generally at 1410. Here, there is data between the tp.hdr 1401 and the 
secL.startjoode 1403. In accordance with the present invention, the packet 1400 is processed by discarding the first 

40 data field 1402, and creating an adaptation fiekJ 1412 with N dummy bytes, as shown in the processed packet 1410. 
In FIGURE 1 4b, the unprocessed packet is shown generally at 1 420. Here, there is no data f ieU t)etween the tp.hdr 
1401 and the seq_slart_code 1403. In accordance vi^ the present invention, the entire packet 1420 Is transmitted 
without modif foatim since there is no data fieM pdor to the seq_8tartjcode 1403. 

A decoder for decoding the output data stream may be provided as dscussed earlier in oonnectfon with FIGURE 

45 1 . For exaitple, the Digital Entertainment Temiinal (DEl^ 168 can include a decoder with an associated data buffer and 
processor. The buffer receives the incoming data stream and provkles the data to the processor for decoding and other 
processing which is required to provide a signal suitable for reproduction on a television. As discussed, the provision of 
null packets in the output data stream v^l prevent a potental buffer overflow at the decoder. 

Accordingly, it can be seen that the present tnventfon provides a method and apparatus for sptidng compressed 

so packetized drgita! video streams. In particular, a secondary packetized data stream, sudi as a commerclat. is spliced 
with a primary packetized data stream, such as a network television program. The system does not require the decom- 
pression of the data in the primary data stream, and is particularly suitable for use at a cable system headend to allow 
the insertion of commerdals from local businesses into a nationally broadcast television program. 

Although the invention has been described in connection with various specific entxxliments. those skilled In the art 

55 win appreciate that numerous adaptations and nvxlif ications may be made thereto wthout departing from the spirit and 
scope of the invention as set forth in tiie claims. For example, it is possible to focate the IPU in the decoder at the sub- 
scrber's home, thereby provMing the subscriber wrtti ttie capabilities of a in-home di^l data nrn'xer such as those used 
at television, radio and recording studios. This would allow ttie sibscriber to ecft various audio, vkleo and data sources. 
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For example, data stored on a DVD or CD-ROM could be spliced with a main program for various educational and enter- 
tainment purposes. 

Claims 

1 . A method for splicing a secondary packetized data stream with a primary packetized data stream, comprising the 
steps of: 

providing a start signal indicatnng a time to initiate said splicing; 
determining a pre-spficing packet o1 said primary stream according to said start signal; and 
providing an output stream where a first packet of said secondary stream is positioned to follow sakJ pre-spilc- 
ing packet 

2. A method in accordance with claim 1 . wherein the packets of sard primary stream have Identifying data associated 
15 therewith, conprising the further steps of: 

retrieving said identifying data of said primary stream; and 
providing said secondary stream with said identifying data. 

£0 3. A method in accordance with claim 1 or 2, comprising the further st^ of: 

providing a number L of null packets in saki output stream to prevent a buffer overflow at a decoder which 
receives said output stream; and 

inserting said null packets between sakI pre-splicing packet and sakf first packet: 
25 wherein saU number L is determined according to respective data rates of saki primary and secondary 

streams. 

4. A method in accordance with one of the preceding claims, comprising the further steps of: 

30 determining a post-splicing packet of said primary stream whfch follows said pre-splfcing packet; 

discarding data of said pre-splicing packet which is associated with said post-splictng packet; arid 
adding an amount of stuff ing data to saki pre-spWng packet according to the amount of data discarded. 

5. A method in accordance with one of the preceding claims, virtierein saki pre-spiicfrig packet is a packet of saki pri- 
35 mary stream with an ancha frame start code whfeh is dosest to saki ste^ 

6. A method in accordance with one of the preceding claims, wherein saki primary stream can-ies conpressed digital 
data, and said splicing does not require decompression of saki compressed digital data. 

40 7. A method in accordance with one of the preceding claims, comprising the further steps of: 

determining a posl-spllcing packet of saki primary stream which fdlkwvs said pre-splicing packet; and 
positioning said posl-spficing packet to foHow a last packet of said secondary stream in said output stream. 

45 8. A method in accordance with claim 7, comprising the further st^ of: 

discarding data of saki post-splidng packet virhich is assodated with a packet of saki primary stream which 
immediateiy precedes saki post-€plk»ng packet; and 

adding an amount of stuffing data to said post-splidng packet according to the amount of data discarded. 

so 

9. A method In accordance with daim 7 or 8, wherein said post-splidng packet is a packet of saki primary stream with 
a sequence start code which directly folk>ws a sequence end code whicfi is assodated with said last packet of saki 
secondary stream. 

55 10. An aFH3aratus for splidng a secondary packetized data stream with a primary packetized data, conprising: 

mear^ for provkiing a start signal indicating a time to initiate saki splk:lng; 

means for determining a pre-splidng packet of said primary stream according to said start signal; and 
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means tor providing an output stream where a first packet of said secondary stream is positioned to follow saM 
pre-spltcing packet 

1 1 . An apparatus in accordance witti claim 1 0. wherein the packets of said primary stream have identifying data asso- 
5 dated therewith, further comprising: 

means tor retrieving said identifying data of said primary stream; and 
means tor providing said secondary stream with said identifying data. 

10 12. An apparatus in accordance with claim 10 or 11 . further comprising: 

means tor providing a number L of null packets in said output stream to prevent a txiffer overflow at a decoder 
which receives said output stream; and 

means tor inserting said null packets between said pre-splicing packet and said first pad^; 
IS wherein said number L is determined according to respective data rates of said primary and secondary 

streams. 

13. An apparatus in accordance with one of daims 10 to 12, further comprising: 

so means tor determining a post-splicing packet of said primary stream which follows saM pre-splidng packet; 

means tor discarding data of said pre-splidng packet which is assodated with said poet-epfidng packet; arid 
means for adding an amount of stuffing data to sad pre-splidng packet according to the amount of data dis- 
carded. 

25 14. An apparatus in accordance with one of daims 10 to 13, wherein said pre-splidng packet is a packet of said pri- 
mary stream with an anchor frame start code which is dosest to sakl start time. 

15. An apparatus in accordance with one of daims 10 to 14. wherein said primary stream canies conpressed d^ital 
data, and said splicing does not require deoompresston d said compressed digital data 

30 

1i6. An apparatus in accordance with one of d^ms 10 to 15. further comprising: 

means tor determining a post-splidng packet of said primary stream which follows saM pre-splidng packet; 
and 

35 means tor positioning said post-splidng packet to follow a last packet of said secondary stream in said output 

stream. 

17. An apparatus in accordance with daim 16, further comprising: 

40 means for discarding data of said post-spUdng packet which is assodated with a packet of said primary stream 

which immediately precedes said post-splidng packet; and 

means for adding an amount of stuffing data to said post-spticing packet according to ttie amount of data dis- 
carded. 

45 1& An apparatus in accordance with daim 16 or 17. wherein said post-splidng packet is a pactet of sM primary 
stream with a sequence start code which directly follows a sequence end code which is assodated with sakl last 
pad<0t of sakJ secondary stream. 

19« A decoder tor decoding a transport data stream which comprises a secondary packefized data stream which is 
so spUced with a primary packetized data stream, wherein a first packet of sakJ secondary stream is positioned to fbl- 
tow a pre-splidng packet of said primary stream, said decoder comprising: 

a buffer for storing said transport data; and 

a processor coupled to receive data from said buffer for processing saki transport data: wherein: 
55 a number L of null packets are provWed between said pre-splidng pactot and said f rsl packet to prevent ovw- 

f low of said buffer; and 

sakl nunf^ L is determined according to respective data rates of said primary and secondary streams. 
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20. A decoder in accordance with daim 19, wherein said nun*er L is determined according to a decoding delay time 
of said decoder. 
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